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Abstract 



In 1989, the National Council of Teachers of Mathematics (NCTM) published the 
Curriculum and Evaluation Standards, setting a new course for K-12 mathematics teaching and 
learning. More than a decade later, this study provides an important and timely analysis of 
trends in mathematics instruction and outcomes, with attention to race- and SES-related 
disparities. 

Utilizing 1990, 1996 and 2000 data from the National Assessment of Educational Progress, 
this study examines race- and SES-related trends in student mathematics achievement, beliefs, 
classroom experiences, course taking patterns, and teachers’ educational backgrounds. Although 
overall mathematics achievement increased between 1990 and 2000, race- and SES-related 
achievement gaps did not improve. SES differences appeared to account for some, but not all 
race-related differences. An examination of classroom practices revealed many similarities in 
students’ experiences that were consistent with the NCTM Standards. However, other aspects 
of mathematics instruction, such as the role of calculators and the use of multiple-choice 
assessments, were found to correlate with student race and SES. Additionally, there were race- 
and SES-related differences in students’ beliefs, such as whether learning mathematics was 
viewed as fact memorization. These correlations with race persisted even after controlling for 
SES. 

The results suggest that White, middle-class students are experiencing more of the 
fundamental shifts called for in the Standards. However, the NAEP is not designed for making 
cause-and-effect inferences regarding instructional methods and student outcomes. This study 
reveals similarities and differences in students’ classroom experiences and attitudes, thereby 
shedding light on factors that could shape achievement differences. 



^ The author would like to thank Megan Brown and Kayoima Camara for their research assistance. The author also 
gratefully acknowledges the ISU College of Education for its support of this research. 
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The year 1989 marked the beginning of a momentous decade of U.S. mathematics education 
reform. In that year, the National Council of Teachers of Mathematics (NCTM) published the 
Curriculum cmd Evaluation Standards, which, along with companion documents published soon 
after (NCTM, 1991; 1995; 2000), set a new course for mathematics teaching and learning in U.S. 
K-12 schools. 

The reformers’ vision offers a dramatic departure from traditional mathematics instruction 
centered around the memorization and practice of teacher-given rules. NCTM calls for 
mathematics instruction to be centered around students’ exploration and discussion of challenging 
problems. Additionally, NCTM promotes revised curricular goals for grades K-12 to include 
greater emphasis on conceptual understanding of measurement, geometry, data analysis, 
probability, algebra, and number. NCTM also argues that a wider variety of tools should be used 
to enhance students’ learning, including manipulatives, calculators, and computers. 

NCTM intends its vision to reach and mathematically empower ^ students, including those 
students previously under-represented in mathematics-based careers. (NCTM, 1989, 1991, 1995, 
2000) In the past, lower-SES and minority students received more than their share of rote-based 
mathematics instruction (e.g., Anyon, 1981; Ladson-Billings, 1997; Means & Knapp, 1991). 
NCTM’s vision of problem-centered instruction for all students challenges the status quo with its 
emphasis on developing mathematical power in all students (NCTM, 1989; 1991; 2000). 

After a decade of reform, it is clear that the Standards documents have made a strong, national 
impact. By 1993, over half of the states had changed their testing or curriculum recommendations 
in light of the Standards (Usiskin, 1993). Additionally, the National Science Foundation funded 
thirteen curriculum development projects to implement NCTM's vision. These curricula were 
making their way into schools by the mid-1990’s, and their use is continuing to expand. 

Despite the standards ’ impact and apparent potential to address past inequities, 
achievement gaps between black and white students began widening during the past decade, after 
narrowing in the 1970’s and 80’s (Campbell, Hombo, & J. Mazzeo, 2000; Jencks & Phillips, 
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1998). Lee (2002) found that during the back to the basics movement, the black-white gap in 
mathematics and reading achievement narrowed due to increases in black students’ achievement 
while the achievement of white students remained steady. Then during the past decade of 
reforms pushing for more complex problem solving skills, achievement gains have been greatest 
for high achieving white students, and this has contributed to the widening of the gap. These 
trends raise the important question of whether recent reforms are, indeed, reaching all students. 

Other studies of black- white achievement gaps have considered the role of teachers, 
curriculum, schools, student motivation, and student resistance (e.g.. Banks, 1989; Cook & 
Ludwig, 1998; Ferguson, 1998a; Ogbu, 1995; Steele & Aronson, 1998). Such discussions tend to 
focus on the overall academic performance and experiences of black students, as opposed to an 
in-depth examination of achievement and instructional practices in a particular subject area, such 
as mathematics. This trend was noted by Lee (2002), who concluded his general analysis of 
trends in achievement data by urging subject matter specialists to examine the issue in their areas 
of expertise. 

This paper focuses specifically on students’ achievement and learning experiences in 
mathematics, which is particularly important to consider in relation to equity because it is used 
as a key gatekeeper to high status occupations. Previously, researchers in mathematics education 
have given some attention to black-white gaps in mathematics achievement, but with limited 
depth and little attention to interactions between race and SES (Lubienski & Bowen, 2000; Tate, 

1997)2. 3 y examining race- and SES-related gaps in mathematics achievement and instructional 

practices and giving attention to interactions between race and SES, this study highlights ways in 

/ 

which race-related achievement gaps could be due to differences in students’ access to 
empowering mathematics instruction. 



^ In a survey of 3,011 mathematics education research articles published between 1982 and 1998, Lubienski and 
Bowen (2000) found 323 articles pertaining to gender, yet only 52 pertaining to social class, and 1 12 pertaining to 
race (with 47 of these concerning black students). Only 13 of the 3,01 1 articles considered race and class together. 
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The National Assessment of Educational Progress 

The National Assessment of Educational Progress (NAEP) is an important tool for 
monitoring trends in mathematics achievement, student attitudes and beliefs, and instructional 
practices. The NAEP is the only nationally representative, ongoing assessment of U.S. academic 
achievement . The NAEP measures student performance at 4***, 8***, and 12*** grades in 
mathematics and other subject areas. The NAEP also provides information from student and 
teacher questionnaires regarding mathematical backgrounds, beliefs, and instructional practices. 

In order to help the reader interpret NAEP results, some information about NAEP is 
necessary. There are actually two different NAEP assessments that are administered to a 
nationally representative subset of students: the Long-Term Trend NAEP and the main NAEP.^ 
The Long-Term trend assessment was created in 1973 and has remained constant over time. 
Hence, the content of the test questions is that which was deemed important in 1973. Most 
analyses of race-related trends in NAEP achievement data have drawn from the Long-Term Trend 
assessment. 

In contrast, the framework that determines the content of the main NAEP assessment is 
responsive to national trends, such as the NCTM reforms. Since 1990, the main NAEP 
mathematics assessment has been shaped by a framework based on NCTM’s Curriculum and 
Evaluation Standards for School Mathematics (1989). Hence, NAEP assesses students’ 
performance on both multiple choice and open-ended questions over the five mathematics strands 
emphasized by NCTM: number/operations, geometry, measurement, data analysis, and 
algebra/functions. Additionally, NAEP survey questions administered to students and teachers 
are designed to identify the extent to which students’ classroom experiences are aligned with 
NCTM’s vision for fnathematics instruction. Hence, the NAEP is designed to monitor students’ 
access to both the curriculum and instructional practices deemed important by current leaders in 
mathematics education. This assessment was administered in 1990, 1992, 1996 and most 
recently 2000. 



^ There is also a third NAEP assessment, the State NAEP, which is administered to samples from each 
participating state. 
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Several publications have delved into particular aspects of the 1996 and earlier NAEP 
mathematics assessments, such as students’ skills in estimation and in solving contextualized, 
mathematics problem (Mitchell, Hawkins, Stancavage, & Dossey, 1999), teacher and student 
practices in mathematics classrooms (Mitchell, Hawkins, Jakwerth, Stancavage & Dossey, 1999), 
as well as students’ performance in each of the 5 mathematics strands: number, algebra, 
geometry, measurement, and data analysis/probability (Silver, & Kenney, 2000). 

Although most NAEP reports focus primarily on overall trends in student achievement and 
instructional practices, some reports have given attention to race, SES and gender (e.g., Kenney & 
Silver, 2000; Mitchell, Hawkins, Jakwerth, Stancavage, & Dossey, 1999; Reese, Miller, Mazzeo 
8c Dossey, 1997). Most notably, Strutchens & Silver (2000) reported on a variety of race-related 
disparities in NAEP data'related to mathematics achievement, students’ beliefs about 
mathematics, and teachers’ instructional practices and emphases. Strutchens & Silver’s findings 
in each of these areas will be summarized briefly. 

Students’ mathematical attitudes and beliefs, although shaped by a variety of factors, are 
likely linked to both students’ mathematics achievement and the instruction they receive. 
Strutchens and Silver (2000) identified several factors that did not correlate with the black- white 
achievement gaps. Briefly, according to the 1996 NAEP data, black and Hispanic students 
reported liking mathematics and believing mathematics is usefiil at least as much as their white 
counterparts. Furthermore, students’ beliefs about the link between effort and achievement did 
not correlate with achievement gaps. In 1996, 67% of white 8th graders versus 87% of black 8th 
graders and 86% of Hispanic 8‘*' graders agreed with the statement, “Everyone can do well in 
math if they try.” 

Still, Strutchens^ and Silver identified some differences in students’ beliefs that could be 
related to the mathematics achievement differences, as well as to the instruction students 
received. Black and Hispanic students were more likely than white students to agree with the 
statements, “There is only one way to solve a math problem” and “Learning mathematics is 
mostly memorizing facts.” 
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Strutchens and Silver also found a number of teacher-reported aspects of mathematics 
instruction that were similar for white, black and Hispanic students^. These areas included the 
use of manipulatives, the use of “real-life” mathematics problems, and student collaboration. 
Additionally, time spent on instruction did not correlate with achievement gaps, with black 
students being most likely to have a teacher who reported spending more than 4 hours per week 
on mathematics instruction. 

However, there were some instructional differences that correlated with achievement gaps, 
white students were allowed more access than to calculators for daily use and on tests than were 
black or Hispanic students. Black and Hispanic students were more likely to be assessed with 
multiple choice tests, particularly at the 4^** grade level. Finally, white students were most likely 
to have a teacher give heavy emphasis to “reasoning skills needed to solve unique problems.” 

Hence, according to previous NAEP data, black and Hispanic students were more likely than 
white students to be tested on finding the single correct answer to problems (on a multiple choice 
test) without the use of a calculator, which suggests basic fact computation as a major 
instructional focus. These differences are reminiscent of those revealed in Anyon’s (1981) study, 
in which lower-SES students were found to receive more drill-based instruction, whereas higher- 
SES students were taught problem solving and reasoning skills. Other scholars (Ladson-Billings, 
1997; Means & Knapp, 1991) have made similar observations about the tendency for black 
children to receive more traditional, drill-based instruction focusing on basic computational skills. 

However, the question remains whether these race-related differences still exist in 2000, as 
well as how these differences relate to SES. Previous publications have tended to report on 
NAEP data using the isolated categories of “race” and “parent education level.” Some authors 
have acknowledged""the conflation of race and SES and have called for further research that would 
help separate these factors. For example, Strutchens and Silver (2000) noted, “Because black 
and Hispanic students are over-represented in low-income categories. . .[it is] difficult to untangle 
matters of race/ethnicity and economic conditions in these NAEP findings.” (p. 51) They caution 
that the race-related differences in NAEP data might be due to SES more than race. Hence, 
previous NAEP reports raise, but do not address the question of whether race-related 

The NAEP sample involves a random sample of students, and not teachers. Therefore, claims must be made at 
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mathematics achievement gaps are primarily attributable to SES differences or to other factors, 
such as access to quality mathematics instruction. 

Consistent with this trend, the most recent NAEP report for the 2000 main mathematics 
assessment provides general information about overall trends in mathematics achievement and 
instructional practices during the past decade (Braswell, Lutkis, Grigg, Santapau, Tay-Lim, & 
Johnson, 2001). This report also highlights several variables that correlate with achievement. 

For example it notes that 8'*’ graders with unrestricted access to calculators scored significantly 
higher than their peers without such access. Similarly, the report states that 4'*’, 8'*’, and 12'*’ 
grade students who agreed with the statement, “Learning math is mostly memorizing facts,” 
scored significantly lower than students who disagreed with the statement (Braswell et al., 2001, 
pp. 179-181). Still, it is important to consider the role of race and SES in these correlations, and 
examine whether such correlations might be due to continuing disparities in low-SES and minority' 
students’ access to reform-based practices. 

Now that the 2000 mathematics data are available, enabling examinations of data points that 
mark the beginning, middle and end of the first wave of Standards-hdiSQd reform, the time is ripe 
for a thorough examination of mathematics practices and outcomes as assessed by NAEP. This 
study goes beyond previously published reports on NAEP by closely examining race- and SES- 
related trends in main NAEP mathematics data, including attention to interactions between race 
and SES. In particular, the following questions are addressed: 

1) How have U.S. mathematics instructional practices and achievement outcomes changed since 
1990? 

2) How have race-'and SES-related gaps in mathematics achievement changed since 1990? To 
what extent are race-related gaps attributable to SES differences? 

3) How have race- and SES-related differences in mathematics instructional practices changed 
since 1990? 



the student, not teacher, level. 
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4) Given concerns about the severity and widening of blacky-white achievement gaps over the 
past decade, to what extent do black-white gaps in instruction persist after controlling for 
SES (and, therefore, could shed light on black-white achievement gaps that go beyond SES)? 

To address these questions, this study utilizes NAEP data to investigate race- and SES- 
related patterns in students’ mathematics performance and instruction. However, it is important 
to note that the NAEP is not longitudinal nor designed for making cause-and-efifect inferences 
regarding instructional methods and student outcomes. Still, identifying instructional factors that 
do and do not correlate with race-related achievement gaps can enrich our understanding of 
students’ experiences with learning mathematics and can suggest important areas for further 
study. Additionally, while not assuming that instruction-related variables are the only, or even 
primary, cause of achievement gaps, it is important to give attention to the area that educators are 
best positioned to address. 

METHOD 

The data used in this study are from the 1990, 1996, and 2000 main NAEP mathematics 
assessments. Data from 4“^, S'*’, and 12'*’ grade mathematics assessments were included, as well as 
data from surveys administered to all participating students and their teachers. (Teacher data are 
for 4'*’ and 8'*’ grade students only — 12'*’ grade teachers are not surveyed due to the large 
numbers of 12'*’ graders not taking mathematics courses). Variables included in this analysis were 
those that pertained to students’ mathematics achievement, student demographics, and 
instruction-related variables, very broadly defined to include factors that characterize or are likely 
related to the instruction students receive. Such factors included students’ course-taking 
practices, students’ attitudes toward mathematics, as well as teachers’ instructional practices, 
curricular emphases, and educational backgrounds. 



5 To be consistent with NAEP survey data, I use the terms “black” and “white,” although I acknowledge that 
differences of opinion exist about these terms. Additionally, like NAEP, I use the term “white” to indicate non- 
Hispanic white students. 
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Before discussing specific analysis methods, some explanation of NAEP’s race- and SES- 
related variables is necessary. From students’ self-reports (or when this information is missing, 
school records), NAEP categorizes students’ race as one of the following; white, black, Hispanic, 
Asian/Pacific Islander, and American Indian (including Alaskan Native). For the equity- 
monitoring purposes of this study, the achievement of black and Hispanic students is compared 
to that of white students, with attention given to the interaction between race and SES. NAEP 
samples for American Indian students were generally too small to be used in this study. Some 
analyses of race-SES interactions in relation to instructional practices involve comparisons 
between white and black students only. This relatively narrow focus is due to concerns about 
the recent increase in the gap between black and white students’ achievement (e.g., Jencks & 
Phillips, 1998) and the persistence of severe black-white gaps after controlling for SES. 

Over the past decade, NAEP has utilized several variables relating to students’ SES. In 1990 
and 1996, parent education level and literacy resources in the home (books, encyclopedia, 
magazines, and newspapers) were used as SES measures at each grade level. In 1996 ffee/reduced 
lunch eligibility was introduced and used again in 2000. Additionally, parent education level was 
no longer used in 2000 at the 4*** grade level, due to concerns about obtaining accurate student 
self-reports of this information. 

The shifting nature of SES-related variables makes it difficult to examine SES-related trends 
over the past decade. Additionally, the 2000 mathematics restricted-release data are not yet 
available, posing another limitation. In order to most effectively use the data available, this paper 
draws upon two separate data analyses. 

Analysis 1: Race- arid SES-Related Trends 1990-2000 

One analysis was conducted with the NAEP web-based data tool, which was introduced in 
fall, 2001. This tool enabled analyses of 1990, 1992, 1996 and 2000 mathematics achievement 
data by race and SES together. The tool also facilitated analyses of instructional practices and 
student beliefs/attitudes, but in relation to only one variable at a time (race or SES). (Again, when 
the restricted release data become available for secondary data analysis, race- and SES-related 
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trends can be studied more thoroughly, with deeper attention to interactions between race and 
SES in the 2000 data.) 

1990 samples consisted of 8,072 students, divided fairly evenly among the 4* 8* and 12* 
grades. Samples for 1992 and 1996 were much larger, each totaling about 21,000 students. In 
2000 sample sizes doubled, totaling over 42,000 students. 

There are several features that make NAEP data particularly difficult to analyze. These 
features include the use of multi-staged, stratified random sampling (in which geographic areas, 
then schools and then students are selected), the oversampling of private school and minority 
students, and the use of plausible values to estimate scores for each student based on his/her 
background and performance on only a subset of items. In this analysis, the crosstabulation 
feature of the NAEP data tool was used to calculate means and standard errors for student 
achievement data, as well as student and teacher questionnaire data. To calculate an achievement 
mean, the tool calculates the mean for each of the five plausible values across students in the 
sample, and then averages the five means. Because sampling procedures create unequal 
probabilities for student selection into the sample, the tool also utilizes sampling weights. A 
student’s overall sampling weight is the reciprocal of his/her probability of being selected. When 
making sampling variance estimates, 62 replicate weights are used for each student, with standard 
errors calculated using the jackknife repeated replication approach. Measurement error is 
calculated as the variance of the five plausible values. Then the overall variance estimates 
combine both the sampling variance and measurement error. For more information about these 
statistical procedures, see Johnson (1992) or Johnson and Rust (1992). 

Mathematics achievement means were compared for white, black and Hispanic students, with 
an eye toward changes in gaps between 1990 and 2000. Not only were overall means compared, 
but performance differences in each of the five mathematical strands were examined. 

Additionally, race-related gaps in the 2000 data were analyzed with attention to interactions with 
students’ eligibility for free/reduced lunch. (Although Parent Education Level has typically been 
used as the main SES indicator in previous analyses, this variable is no longer used in 4* grade. 

To be consistent across grades, lunch eligibility was used for all 3 grades as an SES indicator.) 
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Analysis 2: A Closer T.nok at Race-SES Interactions for Black and White Students 1990-1996 

Due to recent concerns about the widening of black-white achievement gaps (Campbell, 
Hombo, & J, Mazzeo, 2000; Jencks & Phillips, 1998; Lee, 2002) and due to the severity and 
persistence of such gaps even after controlling for SES, a second analysis examined black-white 
differences in instructional practices to determine the extent to which both low- and high- SES 
black students are receiving instruction that differs from that of their white peers. This analysis 
focused strictly on data from the 1990 and 1996 restricted-use data sets. (This analysis could 
not be performed with the 2000 data, because the restricted-use data have not yet been released, 

A more detailed account of this analysis of 1990 and 1996 data is reported in Lubienski, 2001.) 

To examine these issues, an SES variable was created from the two relevant variables present 
in both data sets: literacy resources in the home and parental education. The ideal would have 
been to create a continuous SES variable drawing from a variety of SES-related information, 
including the income, education and occupation of the parents and grandparents of each student. 
However, only home literacy resources and parental education were present in both data sets, 
and both variables were discrete, containing 3-4 values. Parental education information was not 
reported for about one third of 4th graders, posing yet another difficulty. After consideration of 
the much-debated meanings of “social class” and “socioeconomic status” (e.g., Duberman, 1976; 
Secada, 1992; Weis, 1988; Zweig, 1991), four SES levels were created, as shown in Table 1. Each 
SES level contained roughly 25% of students, although this percentage varied by year, grade level 
and race (see Figure 1.) 



Table 1: SES Level Assienments 
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Table Notes: 

1) So few students report having less than 2 of the 4 resources in the home, that NAEP 
collapses the categories to be 0-2 items, 3 items or 4 items. “Parent Education” refers to the 
higher of either the mother or father when they differ. 

2) When either parent education or home environment information was missing, the student was 
assigned to the SES level that he/she was most likely to be in, given the value of the other 
variable. If a student’s parent education and home environment information was missing, the 
student was excluded from SES-based analyses. 



Figure 1 reports the NAEP sample sizes, as well as the percentage of black and white 
students in each SES level. Higher proportions of white students were in the higher SES levels, 
whereas higher proportions of black students were in the lower levels. However, the Figure also 
reports a positive trend of slightly more white and black students in the higher levels in 1996 
than in 1990. Still, the substantial SES disparities between white and black students do not 
appear to be significantly changed. 

Figure 1: 1990 and 1996 Percentages of white and black Students In Each SES Level 
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A software program called NAEPEX, designed by the Educational Testing Service, contains a 
“plug-in” module that works in conjunction with SPSS to address NAEP’s uses of weights and 
plausible values. In this analysis, the crosstabulation feature of the NAEPEX module was used 
to calculate means and standard errors for student achievement data, as well as student and 
teacher questionnaire data. NAEPEX utilizes the techniques described above for calculating 
means and standard errors. 

Black-white differences were examined in conjunction with SES for instruction-related 
variables identified in this and previous studies as correlating with race (e.g., Strutchens & Silver, 
2000). Means were compared between black and white students of each SES level, with an eye 
toward black-white gaps within and across SES categories. In doing so, I sought to determine 
which race-related differences in instruction persist after controlling for student SES, and, 
therefore, could be factors underlying race-related gaps in achievement that persist after 
controlling for SES. 



RESULTS 

This section begins by discussing race- and SES-related mathematics achievement disparities, 
including trends between 1990 and 2000. The focus then turns toward instruction-related issues. 

Overall Mathematics Achievement: 1990-2000 

Despite the concerns about equity raised by this study, it is important to note the good 
news: NAEP scores increased between 1990 and 2000 for white, Hispanic and black students and 
for both low- and high-SES students (Braswell, Lutkis, Grigg, Santapau, Tay-Lim, & Johnson, 
2001). However, substantial gaps remain, and some appear to be growing. 

In order to help the reader interpret the results discussed here, some information about NAEP 
scores is necessary. NAEP uses a consistent 500 point scale on which 4th graders scored an 
average of 228, graders scored 275 and 12th graders scored 301 in 2000. Hence, an 
achievement gap of 9 points can be considered, in very rough terms, a one-year difference. (9 
points would be slightly less than one year at the elementary level and more than one year at the 
secondary level). 
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Table 2: 2000 Achievement By Race 





Fourth Grade 

N=13,511 


Eighth 

N= 15,694 


Twelfth Grade 

N=13,432 


2000 White Achievement 


236 


286 


308 




(I.O) 


(0.8) 


(1.0) 


2000 Hispanic Achievement 


212 


253 


283 


(1-5) 


(1.5) 


(2.1) 


2000 Black Achievement 


205 


247 


274 




(1.6) 


(1.4) 


(1.9) 


2000 Hispanic/White Gap 


24 


33 


25 


2000 Black/ White Gap 


31 


39 


34 


Change in White Ach. 1990-2000 


+16 


+16 


+7 


Change in Hispanic Ach. 1990-2000 


+ 14 


+9 


+ 7 


Change in Black Ach. 1990-2000 


+ 16 


+9 


+6 


Change in HispanicAVhite Gap 
1990 - 2000 


+2 


+7 


0 


Change in BlackAVhite Gap 
1990 - 2000 


0 


+7 


+1 



Table note: Standard errors are in parentheses. 



The 2000 data reveal the persistence of large achievement disparities, with white students 
significantly^ outscoring their black and Hispanic counterparts. As Table 2 reveals, the 2000 
Hispanic-white gap was 24 points at fourth grade, 33 points at 8th grade (up 7 points from 
1990), and 25 points at 12th grade. The 2000 black-white gap was 31 points at fourth grade, 39 
points at 8th grade (up 7 points from 1990), and 34 points at 12th grade. These data indicate 
that the middle grades are a critical time for the growth of both black- white and Hispanic-white 
gaps. 

Overall, Hispanic-white gaps are large but less severe than black-white gaps. Still, the 
magnitude of both Hispanic-white and black-white gaps is great in comparison to the 3-4 point 
gender gaps that exist at 4* 8*^ and 12*^ grade. Another way to put some perspective on the 
severity of these race-related differences, is to examine Figure 2, which highlights that the 

^ Significance tests reported in this article are two-tailed tests, using .05 as the critical p value. 
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achievement of white graders is closer to the achievement of black and Hispanic S'** graders 
than black and Hispanic graders. Moreover, we can see that in 1990, 12‘*' grade black students 
scored similarly to S'** grade white students, but in 2000, the S'** grade white students scored a 
significant 8 points higher than 12‘*' grade black students. The NAEP scale is designed to make 
these cross-grade comparisons. These data do imply that, on average, black students are leaving 
high school with less mathematical knowledge than white graders possess, at least as measured 
by the NAEP assessment. 



Figure 2: Mathematics Achievement by Race. 1990-2000 




1990 1992 1996 2000 
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One might wonder if these gaps are primarily due to socioeconomic differences. School 
lunch eligibility serves as a rough SES indicator for 2000 NAEP data. Table 3 reveals that within 
each racial group, there are gaps between students who are and are not eligible for free or reduced 
lunch, ranging from 6 to 19 points. These data also reveal that black- white and Hispanic- white 
gaps were significant for both eligible and non-eligible students, with the race-related gaps tending 
to be larger in the non-eligible category (indicating that SES correlates more closely with 
achievement for white students than black or Hispanic students, particularly at 12'*' grade). 
Moreover, the relatively small percentage of eligible white students consistently scored equal to 
or higher (often significantly so) than the non-eligible black and Hispanic students. These gaps 
were particularly severe for black and 12'*' grade students. For example, the 5% of white 12'*' 
graders who qualified for free and reduced lunch outscored the black 1 2'*' graders who did not 
qualify for lunch by 19 points. 

Table 3: Mean Achievement bv Race and Lunch Eligibility. 2000 



Fourth Grade Eighth Grade Twelfth Grade 





Eligible for 
free/ 
reduced 
lunch 


Not 

eligible for 
lunch 


Eligible for 
free/ 
reduced 
lunch 


Not 

eligible for 
lunch 


Eligible for 
free/ 
reduced 
lunch 


Not eligible 
for lunch 


White 


221 


238 


270 


289 


294 


309 


(1.7) 


(Ll) 




(1.0) 


(3.6) 


(1.3) 




18% 


60 % 


14% 


63% 


5% 


65% 


Hispanic 


205 


221 


246 


263 


111 


286 


(1.7) 


(2,7) 


(2J) 


(2.4) 


(3.8) 


(2.8) 




59 % 


31% 


53 % 


30% 


37% 


41% 


Black 


/ 200 


' 219 


242 


255 


269 


275 


(1.6) 


(2J) 


a ^6) 


(2.1) 


(2.1) 


(3.0) 




/ 70% 


22% 


56% 


28% 


34% 


43% 


White-Hispardc 

Gap 


16 


17 


24 


26 


17 


23 


White-Black 

Gap 


21 


19 


28 


34 


25 


34 



Eligible 

White/Noa- ^ ^ 

eligible Hispanic 

Gap 

Eligible 

White/Non- 2 15 

eligible Black Gap 



8 



19 




16 



18 
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Table note: The percents are row percents. For example, 18% of white 4*^ graders were eligible for 
free/reduced lunch, and 60% were not. (This information was unavailable for the remaining 22% of 
white students.) 

A Closer Look at 2000 Performance: Mathematical Strands 

In accordance with NCTM’s curricular emphasis on five mathematical strands, NAEP assesses 
student achievement in each of those strands: number, data analysis, algebra, geometry, and 
measurement. Overall student performance varied only slightly by strand (see Table 4). However 
an exploration of race-related gaps on each mathematical strand revealed several patterns. 



Table 4~ Overall Achievement bv Grade and Mathematical Strand. 20qQ 





Number 


Data 


Algebra 


Geometry 


Measurement 


Mathematics 

Composite 


4“' Grade 


225 


230 


232 


227 


228 


228 


8“' Grade 


276 


278 


277 


272 


273 


275 


12“' Grade 


296 


301 


303 


304 


300 


301 



Hispanic-white gaps were largest in measurement at the 8“' and 12“' grade levels (see Figure 3). 
However, the largest disparities across the strands occurred in 8“' grade, where data analysis had the 
largest gap (49 points, as opposed to measurement’s 44 points). . 



Figure 3: 2000 Hispanic- White Gap in Achievement bv Grade and Mathematical Strand 



■ Number 

□ Data 

■ Algebra 

□ Geometry 
Measurement 




HispanicAA/hite Gap HispanicAA/hite Gap HispanicAA/hite Gap 
4th Grade 8th Grade 12th Grade 
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The black-white gaps were largest in measurement for ail three grade levels, with data 
analysis/stati sties taking second place (see Figure 4). This continues a pattern noted in 1990 and 
1996 (Lubienski, 2001). The pattern was most striking in 8“* grade, where the 2000 gap for 
measurement was 58 points, up 19 points from 1990. Black-white gaps were smallest in Algebra, 
whereas Hispanic-white gaps were smallest in Algebra at grade, geometry at 8“* grade, and both 
algebra and geometry at 12“* grade. 



Fiolirp d- 7000 Rlarlf- White Gan in Achievement bv Grade and Mathematical Strand 




Black/White Gap Black/White Gap Black/White Gap 
4th Grade 8th Grade 12th Grade 



Searching for Explanations - Mathematics Instruction and Related Variables 

The N AF.P is not longitudinal nor designed for making cause-and-efFect inferences regarding 
instructional methods and student outcomes. However, analyses of NAEP student and teacher 
questionnaires can reveal similarities and differences in students’ classroom experiences and 
attitudes, thereby shedding light on factors that could shape the achievement differences noted 
above. 

As outlined above, Strutchens and Silver (2000) summarized 1996 NAEP data pertaining to 
race-related patterns in students’ beliefs and school experiences. They identified several aspects 
that differed between black and white students, including beliefs about mathematics involving 
single solution paths and fact memorization, uses of technology, teacher emphasis on reasoning. 
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and student course taking. In this section these and other factors are examined, going beyond 
Strutchens and Silver’s race-focused analyses in two ways. First, race- and SES-related 
disparities in instruction that they identified in 1996 data are examined to see if they persist in 
the 2000 data. Second, because of the severity of black- white achievement differences even after 
controlling for SES, black-white differences in instruction are examined in conjunction with 
student SES. (Again, because the restricted-released 2000 data are not yet available, this latter 
analysis relies oh 1996 data.) 

Student beliefs 

Student beliefs are related to both the instruction they receive and their mathematics 
achievement (although the causal direction involved is generally not clear). As noted previously, 
Strutchens and Silver (2000) reported many similarities across white, Hispanic and black 
students’ attitudes toward mathematics, with Hispanic and black students being at least as likely 
as white students to report liking mathematics, and believing “everyone can do well in 
mathematics if they try.” They found no consistent patterns that correlated with achievement in 
terms of students’ feelings of confidence in mathematics, and believing that mathematics is useful. 
However, there were two beliefs for which race-related differences were found. Black and 
Hispanic students were more likely than white students to agree with the statements, “There is 
only one correct way to solve a math problem” and “Learning mathematics is mostly memorizing 
facts.” 

The 2000 data reveal similar patterns with no major changes in the numbers since 1996 (the 
question was not asked before 1996). Race-related differences persisted in relation to both 
students’ beliefs abqut single solutions to mathematics problems and mathematics learning as 
memorization. 

“There is only one correct way to solve a math problem. ” As in 1996, more 2000 4'*’ and 8'*’ 
grade students again indicated agreement with this statement about single solution paths for 
mathematics problems. Only 13% of white 4'*’ graders and 6% of white 8'*’ graders indicated 
agreement with the statement. However, these percentages were roughly double for black and 
Hispanic students. (See Table 5). Are these disparities primarily due to SES differences that 
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correlate with race? As Table 5 shows, the tendency for more 4'*’ and S'** grade black students to 
agree with this statement persisted at both the low- and high-SES levels, with race-related gaps 
being much larger than the modest SES gaps present within each racial group. 



Table 5: Student Beliefs About the Nature of Mathematics. 1996-2000 





Percentage of students 
agreeing with the statement, 
"There is only one correct 
way to solve a math 
problem. " 


Percentage of students 
agreeing with the statement, 
"Learning mathematics is 
mostly memorizing facts." 




4th 


gth 


12**’ 


4th 


8**’ 


12th 


1996 


White Students 


13 


6 


6 


51 


36 


29 


Hispanic Students 


24 


12 


6 


61 


50 


43 


Black Students 


27 


12 


7 


63 


58 


55 


Lowest-SES Black Students 


21 


12 


8 


60 


60 


65 


Lowest-SES White Students 


16 


8 


9 


56 


45 


39 


Highest-SES Black Students 


' 28 


12 


4 


71 


58 


44 


Highest-SES White students 


10 


5 


6 


44 


31 


25 


All Students 


17 


1 


6 


54 


41 


34 


2000 


All White Students 2000 


13 


1 


5 


48 


31 


31 


All Hispanic Students 2000 


24 


15 


8 


59 


48 


47 


All Black Students 2000 


25 


13 


5 


61 


•55 


55 


All Students 


16 


8 


5 


52 


36 


36 



Table note: The percentages listed are row percents. For example, 13% of White 4“^ graders agreed 
with the statement, “There is only one correct way to solve a math problem.” 






“Learning mathematics is mostly memorizing facts. ” Less than half of white 4*** graders and 
less than a third of white S'** and graders viewed learning mathematics as fact memorization, 
but these percentages were 60% for black and Hispanic 4'*’ graders, 55% for black S'** and 12**’ 
graders, and about 48% for Hispanic 8**’ and 12**’ graders The analysis of race and SES 
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interactions in 1996 data revealed that black students at both low- and high- SES levels held this 
belief more than their white counterparts. Although, on average, students moved away from this 
belief as they progressed through school, the black-white gaps increased at the upper grade levels, 
partly because the percentage of low-SES black students a'greeing with the statement actually 
increased from 60% at the 4“’ and 8'*’ grade to 65% at the 12“’ grade. Although overall, low-SES 
students agreed with the statement more than their high-SES counterparts, there was less of a 
correlation with SES for black students, with the trend actually reversing at the 4“’ grade level 
where more high-SES (71%) than low-SES (61%) black 4“’ graders agreed with the statement. 
Additionally, at each grade level, a larger percentage of high-SES black students than low-SES 
white students agreed that learning mathematics is mostly memorizing facts. Hence, overall, SES 
differences fail to account for a substantial portion of the black-white gap in this belief 

Although a definitive determination of the causes underlying these belief differences is 
beyond the scope of this study, one likely factor is the nature of mathematics instruction 
students receive. The following sections explore differences in mathematics instructional 
practices encountered by black and white students. 

Instructional practices 

NAEP data reveal many similarities in white, Hispanic, and black students’ classroom 
experiences, as reported by both students and their teachers. In their analysis of 1996 data, 
Strutchens & Silver (2000) found that the use of manipulatives, the use of “real-life” mathematics 
problems, student collaboration, student writing, and time spent on mathematics instruction do 
not correlate with race-related achievement gap differences. However, other instructional 
differences were found to correlate with achievement gaps, including the use of calculators, 
computers, and multiple choice tests. 

This study examined 2000 data in each of these areas and found similar patterns in most 
areas. (Again, these analyses focused on teacher survey data from 4* and 8“’ grades only, because 
12“’ grade teachers are not surveyed.) The 1996 data were also examined to determine the extent 
to which student SES accounted for black-white differences. 
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Calculator Use 

Since 1990, NAEP has asked teachers how often they allow students to use calculators both 
in the mathematics classroom and on tests. These data indicate that during the past decade, 
classroom calculator use has dramatically increased, suggesting that the mathematics curriculum 
has moved away from a primary focus on computational skills. For example, in 1990 only 12% 
of 8* grade students had teachers who reported that students used calculators “almost every 
day.” By 1996, this percentage had leaped to 55%, and has since come down slightly to 48%. 
However, these changes have not been implemented with all students, particularly at the 8* grade 
level. 

Throughout the past decade, white eighth graders were allowed more access to calculators for 
daily use (see Figure 5) and on tests (see Figure 6) than were Hispanic or black students. White 
and Hispanic students’ calculator use actually decreased between 1996 and 2000, while black 
students’ use continued to increase, which helped to narrow some gaps. However, white 
students remain significantly more likely than black or Hispanic students to have regular access 
to calculators for daily use and tests. 

Figure 5: Percentage of 8*** Graders Whose Figure 6: Percentage of 8*** Graders Whose 

Teachers Reported Th eir Students Use Tsachers Reported Mowing Studsnts tQ U s. S 

Calculators AJmost Every Dav” bv Race Calculators on Tests. By Race 





Again, one might wonder whether gaps in calculator use correlate more closely with SES or 
race. The in-depth analysis of 1996 data revealed that large portions of the black-white 
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differences were not attributable to student SES differences, as the highest SES black students 
had teachers who allowed less calculator access than teachers of the lowest-SES white students. 
(See Table 6) 



Table 6: Eighth Grade Calculator Use by Race and SES. 1990-1996 





Percentage of 8'** graders 
whose teachers responded 
“almost everv dav” to “How 
often do students use a 
calculator?” 


Percentage of 8'** graders 
whose teachers responded 
“yes” to “Do you permit the 
use of calculators on tests?” 




1990 8“* 1996 8“* 


1990 8‘^ 


1996 8‘*’ 




Grade 


Grade 


Grade 


Grade 


Lowest-SES Black Students 


6 


28 


11 


43 


Lowest-SES White Students 


6 


51 


25 


62 


Highest-SES Black Students 


10 


41 


25 


56 


Highest-SES White students 


21 


65 


40 


78 


All Black Students 


5 


32 


18 


51 


All White Students 


14 


61 


33 

rr _ri _ oth 


73 



Table Note: The percentages given are row percents. For example, in 1990, 6% of low-SES black 8“' graders had 
teachers who reported that students use calculators “almost every day.” 



Computer Use 

According to teacher reports, black and Hispanic students had at least as much computer use 
in their mathematics^ classrooms as did white students. However, there were some differences in 
the ways in which this technology was used, particularly at the 8* grade level. (See Figure 7.) 
More teachers of black students than white or Hispanic students reported that instructional 
computer use was primarily for drill and practice and games. Fewer Hispanic students than 
white or black students saw computers used for simulations, applications or demonstrations of 
new topics. The analysis of race and SES in 1996 data revealed that SES did not account for the 
differences between black and white students, as computers were used primarily for drill .and 
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practice in the classrooms of more high-SES black students (24%) than low-SES white students 
(16%). These findings indicate that access to classroom computers does not correlate with 
mathematics achievement gaps, however ways in which the computers are used could relate to 
the gaps. Still, the differences in computer use are not necessarily a direct cause of achievement 
gaps, but are at least another indicator of race-related disparities in instructional practice. 

Figure 7: Primary use of computers for mathematics instruction bv race/SES of 8*^ grade student 
( teacher reported! 

60 

50 

40 

30 

20 

10 

0 

Drill and practice Playing games Simulations, Do not use the 

applications, or computer 
demonstrations of 
new topics 

Multiple Choice Tests 

/ 

Contrary to what one might expect given the current NCTM reforms, multiple choice test use 
actually increased between 1996 and 2000. (See Figure 8.) The percentage of students whose 
teachers reported using multiple choice assessments at least once or twice a month jumped from 
48 to 60 for 4“* graders and 34 to 44 for 8“* graders between 1996 and 2000. However, the 
percentages continue to vary widely by race. The disparities were particularly large at the 8“* 
grade level, where 63% of black students, 44% of Hispanic students and 38% of white students 
were assessed with multiple choices tests at least monthly. 



■ 2000 All Black 

□ 2000 All Hispanic 

□ 2000 All White 
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Figure 8: Percentage of 4^*^ and 8^*^ Graders Whose Teachers Reported Using Multiple Choice 
Assessments At Least Once or Twice a Month. 1996-2000 




The 1996 analysis of race and SES together revealed that 4* grade black students of all SES 
levels were more likely than white students to be assessed with multiple choice assessments. 
High-SES white 4* graders (29%) were less likely to have multiple choice tests than their low- 
SES counterparts (45%), but SES patterns were absent for black 4* graders, with about 65% of 
black students at each SES level encountering multiple choice tests at least monthly. Hence SES 
differences between black and white students do not seem to underlie the black-white disparities 
in multiple choice testing. 

These differences in student assessment suggest that white students might gain more 
experience with open-response assessments than do Hispanic or black students. Hence, these 
differences could' relate to the fact that omit rates are higher for Hispanic and black students than 
white students on NAEP’s open-ended assessment items. Race-related performance gaps are 
particularly large for these items as well. (See Lubienski, in press; Strutchens and Silver, 2000) 
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Teacher emphases 

As part of the NAEP teacher survey, 4*** and 8*** grade teachers were asked about the 
emphasis they place on each of the five mathematics content strands, as well as four additional 
topics: facts and concepts, skills and procedures needed to solve routine problems, reasoning 
skills for solving unique problems, and communication of mathematical ideas. The scale teachers 
were given to indicate their emphasis on each topic consisted of four options; “A lot of 
eniphasis,” “some emphasis,” “a little emphasis,” or “no emphasis”. Overall, there was 
remarkable consistency across both student race and SES in terms of the emphasis teachers 
reported giving to most topics, and what patterns did exist tended to correlate inversely fi*om 
what might be expected given achievement trends. Most notably, despite the large gaps in 
measurement achievement, teachers of white 8*** graders actually report emphasizing measurement 
less than teachers of black and Hispanic 8^** graders. For example, 20% of white 8^** graders had 
teachers who reported giving only “little emphasis” to measurement, in contrast to 12% for black 
and Hispanic students. 

In 1996, the most marked differences in the teacher emphasis data involved 8^** grade teachers’ 
reported emphasis on reasoning skills for solving unique problems, with white and Hispanic 
students more likely than black students to have teachers who reported giving substantial 
emphasis to this topic. However, in 2000 the gaps were closed. 

Teachers were also asked how prepared they felt to teach each of the 5 strands, as well as 
how prepared they felt to use manipulatives and to teach estimation, computers, and problem 
solving. There were no significant differences favoring white students in any of these areas. 

Still, meaningful differences might be masked in these data on teacher emphases and 
preparedness. The'^three-four point scale used on the teacher survey items is rough and perhaps 
insensitive to actual differences in teacher emphases or feelings of preparedness. Also, the 
NAEP surveys do not distinguish among the many topics within each strand. 

Teacher educational background 

Teacher knowledge of the NCTM Standards increased slightly for all groups between 1996 
and 2000, with gains greater at the 4^** than 8^** grade level. (See Table 7.) In 2000, 63% of 
fourth graders and 87% of eighth graders had teachers who reported being at least “somewhat 
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knowledgeable” about the NCTM Standards. Variations across race- and SES-related subgroups 
were small and not statistically significant. 

Table 7: Percentage of student.s whose teachers reported being at least “somewhat 
knowledgeable” about the NCTM Standards bv race and lunch eligibility. 1996-20QQ 





4^** Grade 


8^** Grade 


1996 


White students 


54 


81 


Hispanic Students 


54 


79 


Black Students 


59 


84 


Not eligible for fi"ee/reduced lunch 


53 


83 


Eligible for fi"ee/reduced lunch 


54 


83 


2000 


•White students 


66 


89 . 


Hispanic Students 


59 


83 


Black Students 


64 


85 


Not eligible for fi'ee/reduced lunch 


68 


89 


Eligible for fi'ee/reduced lunch 


63 


85 



One might wonder if differences in teacher instructional practices are rooted in differences in 
teachers’ educational backgrounds. To explore this conjecture, differences in the academic 
preparation of 4^^ and 8^^ grade teachers were examined (again, teacher surveys were not 
administered to grade teachers.) 

The percentages of black, white and Hispanic students whose teachers held masters’ degrees, 
were certified in their fields, spent time in mathematics education workshops, or had taken 
particular mathematics education or mathematics content courses were examined. No significant 
race- or SES-related differences were found at the 4^^ grade level. One difference was identified 
involving teacher' certification at the 8^ grade level. Whereas only 80% of white 8 graders had 
teachers who were not certified in secondary mathematics education, only 72% of Hispamc and 
black 8^ graders had such teachers. The disparity between students who were eligible for free 
lunch and those who were not was similar. (See Table 8.) 

On average. Eighth grade students whose teachers were certified in secondary mathematics 
scored a significant 14 points higher on the NAEP mathematics assessment than those students 
whose teachers were not certified in secondary' mathematics education. However, caution must 
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be exercised in concluding that differences in teacher backgrounds are causing these achievement 
differences. These differences in achievement between students of certified and non-certified 
teachers do persist within each race and SES category, but further research accounting for all 
potential confounding variables would be necessary before a causal relationship could be 
determined. Still, these data suggest that differences in teachers’ knowledge of mathematics could 
play a role in achievement gaps, particularly at the S'** grade level. 

Yet overall, there were remarkably few differences in teacher background, according to the 
NAEP measures. However, it should be noted that NAEP’s basic measures of teacher course 
taking and degrees earned do not indicate how well teachers mastered the subject matter in those 
courses. Other evidence (e.g., Ferguson, 1998c) suggests that black students are more likely to 
have teachers who score lower on teacher competency tests. 



Table 8 - Teacher Educational Background bv Race and SES. 200Q 





Certified in 
Elementary (or 
middle school) 
Education 


Certified in 
Secondary 
Mathematics 


Hold at least a 
Master’s Degree 




4th 


8 th 


4 th 


8 th 


White students 


96% 


80% 


40% 


44% 


Hispanic Students 


92% 


72% 


41% 


41% 


Black Students 


92% 


72% 


40% 


45% 


Not eligible for ffee/reduced lunch 


97% 


84% 


43% 


‘ 41% 


Eligible for fi'ee/reduced lunch 


94% 


76% 


39% 


44% 


TOTAL 


95% 


78% 


40% 

. 1 .. 


44% 



Table note: The percentages given are row percents. For example, 96% of white 4'*’ graders are 
certified in elementary (or middle school) education. 



Student course taking 

NCTM promotes a. core secondary mathematics curriculum, with all students taking 
mathematics throughout their high school careers. NCTM argues that all students need a 
mathematical foundation that will allow them access to a wide range of future opportunities, 
including advanced study of mathematics. Perhaps the most important factor that determines 
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whether high school students gain a solid mathematics foundation is student course-taking. 
Differences in the courses students take can shed light on race- and SES-related gaps in secondary 
mathematics achievement. 

In 2000, more white students than Hispanic or black students took geometry, algebra II, pre- 
calculus and calculus (see Figure 9). For example, the percentage of students taking geometry 
were 84%, 71% and 74% for white, Hispanic and black students, respectively. Gaps are similar 
for algebra Il/trigonometry, and pre-calculus. Gaps are slightly smaller for calculus, with slightly 
more Hispanic students taking calculus than black students. 

The 1996 black-white gaps in pre-calculus and calculus enrollment were examined in 
conjunction with SES. For precalculus, the black-white gap was actually reversed at the lowest- 
SES level with more black students (14%) than white students (1 1%) reporting taking precalculus 
for at least a year. But at the highest SES level, more white students (35%) than black students 
(23%) reported taking precalculus. 

More white students than black students took calculus at each SES level, with a 5% gap (2% 
versus 7%) at the lowest-SES level and 4% (15% versus 19%) at the highest-SES level. Overall, 
this analysis of race and SES together revealed that SES-related gaps were larger than the race- 
related gaps, and SES accounted for much of the race-related gaps in upper-level course taking. 

Figure 9: Percentage 12^*^ Graders Who Reported Having Taken High School Mathematics 
Courses by Race. 2000 
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However, course-taking differences do not begin in high school. The mathematics students 
take in 8*** grade influences the courses taken in high school. There are signiflcant race-related 
gaps in the percentages of students who took algebra before high school. 25% of white students 
reported taking algebra in 8*** grade, compared with 15% of black students and 13% of Hispanic 
students. However, gaps based on school lunch eligibility and parent education level were 
slightly larger, again indicating that course taking differences are more closely related to SES than 
race. 

In general, course taking differences leave race-related achievement gaps largely unexplained. 
Course taking gaps appear to be more closely tied to SES than race, with the gaps between the 
lowest- and highest-SES levels being more consistent and larger than the black-white gaps. 
Achievement gaps shrink between 8“* and 12'*’ grades, instead of enlarging as one would expect if 
course taking differences played a primary role in achievement gaps. (Still, the fact that there are 
course taking differences at the S'** grade level, and the fact that high school “drop outs” are not 
surveyed at 12'*’ grade needs to be considered in interpreting these data). Another way in which 
the limited explanatory power of course taking is revealed is through comparisons of those 
students who took the same courses. For example, 14% of white students reported taking 
calculus in 12'*’ grade, compared with 5% of black students and 6% of white students^. But the 
score gaps for these calculus students were again severe, with the white students scoring 344, 
black students scoring 314 and Hispanic students scoring 318. It is worth noting that these black 
and Hispanic calculus students did score higher than the overall white average of 308: However, 
they lagged far behind their white calculus-taking peers. Hence, course taking is a factor that 
correlates with achievement gaps, but it leaves much of the race-related gaps unexplained. 



1 Figure 5 shows slightly higher figures for calculus takers because that includes all students who took calculus 
anytime in high school, as opposed to solely during 12 grade. 
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DISCUSSION 

After a decade of reform intended to change mathematics instruction, increase mathematics 
achievement, and reduce inequities, much work remains. It is important to note the successes of 
the reforms. NAEP data indicate that, major shifts in instruction have occurred. For example, in 
1990, only 32% of 8‘*’ graders had teachers who permitted the use of calculators on tests. That 
percentage was doubled in 2000. Additionally, mathematics achievement increased significantly 
for white, black and Hispanic students of both low and high SES between 1990 and 2000. 

Despite these important successes, inequities in mathematics, outcomes have not improved. 

In fact, the inequities have increased at the 8‘*’ grade level.* Particularly disturbing is the fact that 
the performance of black 12‘*’ graders was lower than that of white 8‘*’ graders, and that the 
lowest-SES white students scored equal to or higher than the highest-SES black students. 

These results raise the question of how these gaps in performance can be explained. It should 
be noted that even when gaps appear to be rooted in “SES” differences, such differences do not 

actually “explain” the gaps (Secada, 1992).9 But black- white gaps that persist after considering 
SES raise further questions about explanatory factors. In recent years, many researchers have 
struggled to understand underlying causes of race-related achievement gaps. Clearly, SES 
differences involving parent education, occupation, income, and educational resources in the home 
account for much of these gaps (Jencks & Phillips, 1998; Peng, Wright, & Hill, 1995). Other 
scholars have considered the role of teacher expectations, school structure, student motivation, 
and student resistance (e.g.. Banks, 1989; Cook & Ludwig, 1998; Ferguson, 1998; Ogbu, 1995; 

Steele & Aronson, 1998). These discussions have tended to focus on the overall academic 

/ 

performance and experiences of students, as opposed to an in-depth examination of achievement 
and instructional practices in a particular subject area. By looking in depth at how achievement 

^ NAEP trends must be considered in the context of other research, such as a recent TIMSS report that indicated a 
narrowing of the black-white gap for 1999 8“^ graders, (when compared with 4* graders tested four years earlier), and 
a widening of gaps relating to parental education (US Department of Education, 2001). Other authors have warned 
that black-white gaps in mathematics and other subject areas have widened over the past decade (e.g., Lee, 2002; 
Jencks & Phillips, 1998). 

^ Secada raises the important point that researchers tend to “control” for SES and then seek no further explanations 
for SES-based differences. Additional research is needed to understand the many home- and school-related factors 
that underlie SES-related achievement differences. 
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gaps vary by mathematical strand, and by examining disparities in students’ access to reform- 
based mathematics instructional practices, this study sheds new light on potential factors 
underlying achievement gaps — factors over which educators and policy makers have control. 

Student course taking appears to be one factor underlying gaps at the secondary level. 
However, given that students generally take the same courses in elementary school, and given 
that course taking differences appear more closely tied to SES than race, such differences leave 
much of the race-related achievement gaps unexplained. 

This study looked beyond which courses students were taking, and examined the 
instructional practices occurring within students’ mathematics classrooms. There are several 
aspects of students’ beliefs and classroom experiences that do not correlate with achievement 
disparities. For example, black and Hispanic students were at least as likely as white students to 
report liking mathematics. Additionally, there were few consistent SES- or race-related gaps 
found in the use of manipulatives, “real-life” mathematics problems, writing in mathematics class, 
student collaboration, and time spent on instruction. Moreover, no significant differences were 
found in teachers’ reported knowledge of the NCTM Standards, their reported emphasis on 
many central tenants of the Standards, and their feelings of preparedness to teach the content 
strands outlined in the Standards. 

However, this study identified several instructional differences that could relate to 
achievement disparities. First, the wide variation in the 8‘*’ grade race-related gaps across the 
strands suggests that curricular variation across schools and classrooms might underlie some 
portions of these gaps. For example, white 8‘*’ graders scored a full 59 points higher (roughly 6 
grade levels) in measurement than black 8‘*’ graders. Additionally, there were race- and SES- 
related differences in students’ beliefs that there is only one correct way to solve a mathematics 
problem and that mathematics learning is primarily fact memorization. Additionally, black and 
Hispanic students had less access to calculators in mathematics classrooms and were more often 
assessed with multiple choice tests. These data indicate ways in which white and high-SES 
students were more likely than their less advantaged peers to be receiving Standards-h^std 
instruction. Additionally, the examination of race/class interactions in 1996 data indicated that 
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the instnictional differences between black and white students persisted, after accounting for 
student SES. 

Although the instruction-related differences identified might appear minor when compared 
with the many similarities reported in classroom practices, these differences in both student 
beliefs and experiences suggest a consistent pattern of lower-SES, black, and Hispanic children 
tending to be taught and assessed with an emphasis on low-level skills. Again, such differences 
align with those found by Anyon (1981) in her examination of social class and differences in 
instructional/curricular practices. However, this study indicates that such differences in practice 
are related to students’ race as well as their SES, with high-SES black students likely to encounter 
many of the practices that low-SES students generally encounter. This provides evidence that, 
almost 50 years after Brown v Board, schools continue to employ unequal educational practices 
with students on the basis of race, in addition to SES. 

Limitations 

There are several limitations of this analysis. First, as mentioned previously, the SES 
variable used in this study relies on students’ self-reports of parent education and literacy 
resources in the home. This can be particularly problematic at the fourth grade level (at which 
1/3 of the students report not knowing their parents’ education level). Readers should consider 
this when viewing trends across grades, because the SES variable becomes more reliable as the 
grade level increases. 

Other limitations of the SES variable used in this study include its exclusion of family income 
and parental occupation information. This, in conjunction with census data indicating different 
income distributions' for white, Hispanic, and black populations (U.S. Census Bureau, 1998), 
implies that withih-SES group comparisons among white, Hispanic, and black students must be 
interpreted with care. That is, although some white, Hispanic, and black students were classified 
together as “low-SES” or “high-SES” in this study, there were likely substantial SES-related 
differences between them that a more sensitive SES variable would expose. Hence, when 
variables appear to be more related to race than SES, one must consider that a stronger SES 
variable might strengthen the SES relationship. 
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Another caveat to note is that NAEP classroom practice data are based on teacher and 
student self-reports, and differences in question interpretations or perceived pressure to portray 
instruction in particular ways could have affected student and teacher responses to questions. 

There are many facets not included in NAEP assessments that are likely important factors in 
shaping both instructional practices and achievement gaps. 

There are several factors that were beyond the scope of this article. Examples include class 
size, teachers’ expectations of students, teachers’ involvement with students outside of the 
classroom, and the many more subtle aspects of students’ opportunities to learn mathematics 
(e.g., see Tate, 1995). Additionally, this study did not consider gender in conjunction with race 
and SES, because boys and girls who are sitting together in the same mathematics classrooms 
would presumably have roughly the same access to the same reform-based instructional 
practices. (This is not to say that more subtle forms of disparities in instruction are not 
occurring for boys and girls, but these aspects would be unlikely identified in the large-scale, self- 
reported NAEP data). Still, more detailed studies of achievement trends should consider 
interactions among race, SES and gender. Additionally, more in-depth, qualitative studies are 
needed to examine interactions among race, SES and gender in students’ experiences in 
mathematics classrooms. 

Finally, although white and higher-SES students appear to experience more of the 
instructional practices promoted by current reformers, one cannot conclude that these practices 
are the cause of their higher achievement. The instructional practices reported for each student 
are only those the student is encountering at the time the NAEP assessment is administered. 
Hence, students’ experiences in previous years with other teachers are not reflected in the NAEP 
classroom practice data. One important potential confounding variable not examined in this 
study is school-level SES. Perhaps more mid-SES Afincan American and Hispanic students were 
in the relatively low- SES schools studied, and, therefore, some race-related differences that 
persisted after controlling for student SES were due to school SES. Further examinations of 
NAEP data should attempt to clarify the role of school-level SES in the correlations among race 
and instructional practices. 
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Conclusion 

Current reforms in mathematics education, led by the National Council of Teachers of 
Mathematics (1989; 1991; 2000) are intended to rectify past inequities by offering all students a 
mathematics education centered around mathematical problem solving and critical thinking. The 
gaps uncovered in this study suggest that white students — especially those of high-SES are 
experiencing more of the fundamental shifts called for by NCTM. Such shifts involve teachers 
and students moving away from a conception of mathematics learning as memorization and. 
computational rule practice to one that emphasizes mathematical reasoning and understanding. 

The fact that disproportionate number of African American and Hispanic students view 
mathematics learning as memorization suggests that these students are being left behind in the 
current reform movement. 

This study raises but does not answer questions regarding the reasons for instructional 
differences between white and minority students, as well as between lower- and higher-SES 
students. One common explanation is that teachers have low expectations of black and lower- 
SES students and, therefore, emphasize only basic, low-level skills when teaching these students 
(Ferguson, 1998a). Yet perhaps a more complex interpretation should be considered. 
Administrative support for teachers, community expectations of teachers, and student resistance 
to particular instructional methods could all be factors in determrning which students receive 
Standards-hd&Qd instruction. 

It could be, for example, that race- or SES-related differences in students’ views about the role 
of memorization in learning mathematics initially stem from cultural differences, that teachers 
then adapt to and magnify through instruction. Indeed, some authors have discussed ways in 
which some students can have particular culture-based orientations to learning, most notably in 
literacy (Delpit, 1986; Heath, 1983) but also in mathematics (Lubienski, 2000a; 2000b). Such 
studies suggest that implementing reform-oriented curricula and pedagogies without attention to 
the particular strengths and needs of minority or low-SES students will not automatically narrow 
achievement gaps. However, more in-depth, sociocultural studies are needed to identify just 
what those strengths and needs are and how they might relate to current instructional trends 
(particularly in mathematics education where such studies are especially rare — Forman, in 
press). 
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With NCTM’s (2000) recent afBrmation of its vision of mathematical power for aU, it is 
particularly important that researchers continue to monitor and seek to address inequities in both 
outcomes and instructional practices that relate to such outcomes. The NAEP offers one avenue 
for examining disparities in achievement, student/teacher attitudes, and classroom practices. The 
patterns identified in this study set the stage for a more thorough examination of the 2000 
restricted-release NAEP data, scheduled to be released in spring, 2002. 
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